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(54) Image processing system via network 

(57) The technique of the present invention ensures 
output of an image subjected to image processing, 
which does not depend upon the output environment but 
reflects the color reproduction characteristics of a shoot- 
ing device and the intention of a photographer in shoot- 
ing. The process generates an image file that includes 
picture data generated by a digital still camera, as well 
as control data and output specification information at- 
tached thereto. The control data controls the details of 
image processing according to the color reproduction 
characteristics of the camera and the intention of the 
photographer in shooting. The output specification in- 
formation specifies, for example, the address of a print- 
ing device used as an output resource, the type of print- 
ing paper used for printing, and the number of copies. 
The image file is transmitted to an image processing 
system on a network. The image processing system car- 
ries out image processing of the picture data based on 
the control data, generates an output file, and transmits 
the output file to an specified output device via the net- 
work. Even in the environment that can not perform im- 
age processing based on the control data, the arrange- 
ment of the invention ensures output of the image that 
has been subjected to such image processing. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001 ] The present invention relates to a technique of 
outputting an image by utilizing an image file, which in* 
eludes picture data and image processing information 
of the picture data. 

Description of the Related Art 

[0002] As a recent trend, the popular procedure gen- 
erates picture data with a shooting device, such as a 
digital still camera (DSC), a digital video camera (DVC), 
or a scanner and outputs an image from an image output 
device, such as a CRT, an LCD, a printer, a projector, or 
a TV set. The output image may not accurately repro- 
duce the brightness or the color tone of a subject, due 
to the difference in color reproduction characteristics be- 
tween the shooting device and the image output device. 
Retouching of picture data is generally carried out to cor- 
rect such a difference in color reproduction. 
[0003] Significant skill is, however, required for such 
retouching. Adjustment of color reproduction is thus dif- 
ficult, time- consuming and labor-consuming. Some ap- 
plication programs have been proposed to analyze the 
picture data and perform automatic correction of the 
color tone and the sharpness. But such correction does 
not give the sufficient result since the characteristics of 
the shooting device are not reflected. In some cases, 
even unnecessary correction is carried out against the 
intention of the photographer in shooting. One applica- 
ble procedure transmits information regarding the char- 
acteristics of the shooting device and the intension of 
the photographer to the image output device and causes 
the image output device to carry out required correction 
based on the transmitted information prior to output of 
a resulting image. This procedure, however, undesirably 
restricts the output resource to the output environment 
that can utilize such information. 
[0004] These problems are not intrinsic to the shoot- 
ing devices, but similar problems arise in the process of 
generating picture data by computer graphics. 

SUMMARY OF THE INVENTION 

[0005] The object of the present invention is thus to 
provide a technique that ensures output of an image that 
reflects characteristics of a device for generating picture 
data and the intention of an operator who makes the pic- 
ture data without significantly limiting the output envi- 
ronment. 

[0006] At least part of the above and the other related 
objects is attained by a first image processing system 
of the present invention that is connected with a printing 
device and a shooting device via a network. The printing 



device and the shooting device may be connected to the 
network directly or indirectly. In the latter application, for 
example, the printing device is locally linked with a com- 
puter connecting to the network. The network may be a 

5 wide area network like the I ntemet or a relatively limited 
network like a LAN (Local Area Network). 
[0007] The image processing system of the present 
invention carries out image processing on picture data 
and causes the printing device to perform printing via 

io the network. The picture data is associated with image 
processing control data. In one preferable embodiment, 
the picture data and the image processing control data 
can be included in an image file. 
[0008] In order to actualize the above functions, the 

15 image processing system first receives the picture data 
generated by the shooting device. A digital camera or a 
scanner may be used for the shooting device. 
[0009] After receiving the picture data, the image 
processing system causes the picture data to be sub- 

20 jected to image processing based on the image 
processing control data and conversion into a data for- 
mat that allows supply to the printing device, thereby 
generating print data. The conversion includes a color 
conversion process, for example, from one color system 

25 of red (R), green (G), and blue (B) used for generation 
of the picture data to another color system of cyan (C), 
magenta (M), yellow (Y), and black (K) used in the print- 
ing device, as well as a halftoning process. 
[0010] The image processing system transmits the 

30 print data to the printing device via the network and 
causes the printing device to print a resulting image. The 
printing device used as the output resource may be set 
in advance or may be specified by the user for each 
printing operation. The output resource may be speci- 

35 fied by information representing the location of the print- 
ing device on the network, for example, address or a 
URI (Uniform Resource Indicator). 
[0011] The user transmits the picture data from the 
shooting device to the image processing system and en- 

40 ables a resulting image to be printed with an arbitrary 
printing device. The image processing system carries 
out image processing based on the image processing 
control data associated with the picture data in the proc- 
ess of generating the picture data by the shooting de- 

45 vice. This ensures the image processing that reflects the 
characteristics of the shooting device and the intension 
of the photographer in shooting. A specific format of print 
data is applied for data transmission from the image 
processing system to the printing device. This enables 

so printing based on the image processing control data, re- 
gardless of the functions of the printing apparatus. The 
technique of the present invention thus ensures printing 
that reflects the characteristics of the shooting device 
and the intention of the photographer in shooting without 

55 any limitation of the printing environment, 

[0012] The present invention is also directed to a sec- 
ond image processing system that is connected to an 
image output device via a network. The image output 
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device is not restricted to the printing device but may be 
a display device, such as a liquid crystal projector or a 
display. 

[0013] The second image processing system first re- 
ceives input of picture data and image processing con- 
trol data used for image processing of the picture data. 
The input of the picture data is not restricted to input 
from a device that generates the picture data. The pic- 
ture data may be input not via the network but via some 
medium. The image processing system then causes the 
picture data to be subjected to image processing based 
on the image processing control data and thereby gen- 
erates an output data. The image processing system 
transmits the output data to the image output device 
connecting to the network and causes the image output 
device to output a resulting image. 
[0014] The arrangement of the second image 
processing system carries out image processing based 
on the image processing control data, regardless of the 
output environment. 

[0015] In the second image processing system, it is 
preferable that the image processing module carries out 
conversion into a data format that allows direct supply 
to the image output device. This ensures output of a 
processed image without requiring any further process- 
ing in the image output device. When the image output 
device is a printing device, the color conversion and the 
halftoning process discussed previously are included in 
this conversion process. The image processing module 
may alternatively transmit output data in a data format 
that enables output from the image output device with 
a predetermined series of processing. 
[0016] In the second image processing system, it is 
also preferable that the image processing module se- 
lectively changes the details of the conversion process 
corresponding to the type of the image output device. 
This enables output of a processed image to diverse im- 
age output devices. The changeover of the conversion 
process corresponding to the image output device may 
be based on a user's input of information regarding the 
type of the image output device. The image processing 
system may otherwise fetch the required information 
from the specified image output device. 
[001 7] Here the type represents a unit that affects the 
contents of the conversion. For example, in the case 
where a common format is applied for the format of out- 
put data in a manufacturer of image output devices, the 
type information is the manufacturer's name of the im- 
age output device. 

[0018] The user may individually specify output style 
from the image output device. In one preferable embod- 
iment, however, the picture data is associated with out- 
put specification information for specifying output style, 
and the image processing system controls the output 
from the image output device based on this output spec- 
ification information. The output specification informa- 
tion includes, for example, information for specifying the 
output resource and information regarding the date and 



time of output. When a printing device is used as the 
image output device, the output specification informa- 
tion may include the size and the type of printing paper 
used for printing and the number of copies. 
5 [0019] In the case where the picture data is defined 
in an YCbCr color space, the image processing carried 
out in the image processing system of the present in- 
vention includes color space conversion from the YCbCr 
color space to an RGB color space. The arrangement 
10 of executing the color space conversion in the image 
processing system enables the color reproduction char- 
acteristics at the time of generating the image file to be 
kept regardless of the output environment. 
[0020] For example, an sRGB color space is typically 
15 used as the RGB color space. Some picture data re- 
quires a wider range of color reproduction than that of 
the sRGB color space. The arrangement of performing 
the color conversion in the image processing system en- 
ables the color reproduction characteristics to be kept 

20 even in such cases. In order to allow the processing in 
a wider range of color reproduction, it is desirable that 
the color space conversion process includes conversion 
into a predetermined RGB space having a wider range 
of color reproduction than the sRGB color space. The 

25 color space conversion process is not restricted to the 
conversion into the color space having the wider range 
of color reproduction, but includes a diversity of conver- 
sion processes, for example, conversion into a color 
space having a relatively narrow range of color repro- 

30 duction but a high resolution. Any of the diverse conver- 
sion processes may be applied selectively. 
[0021 ] The technique of the present invention is actu- 
alized by an image processing method and an image 
output method, in addition to the image processing sys- 

35 tern discussed above. The technique of the present in- 
vention is further attained by a computer program that 
utilizes a computer to construct the image processing 
system discussed above and by a recording medium in 
which such a computer program is recorded. Typical ex- 

40 amples of the recording medium include flexible disks, 
CD-ROMs, magneto-optic discs, IC cards, ROM car- 
tridges, punched cards, prints with barcodes or other 
codes printed thereon, internal storage devices (mem- 
ories like a RAM and a ROM) and external storage de- 

45 vices of the computer, and a variety of other computer 
readable media. 

[0022] These and other objects, features, aspects, 
and advantages of the present invention will become 
more apparent from the following detailed description of 
50 a preferred embodiment with the accompanying draw- 
ings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
55 [0023] 

Fig. 1 schematically illustrates the construction of 
an image output system in one embodiment of the 
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present invention; 

Fig. 2 illustrates the structure of a digital still camera 
10 used as an image file generation device; and 
Fig. 3 is a flowchart showing an image processing 
routine. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0024] One mode of carrying out the invention is dis- 
cussed below as a preferred embodiment in the follow- 
ing order: 

A. Construction of System 

A1 . Structure of Image File 

A2. Structure of Image Processing System 

B. Structure of Digital Still Camera 

C. Image Processing 

D. Effects 

E. Modifications 

A. Construction of System 

[0025] Fig. 1 schematically illustrates the construction 
of an image output system in one embodiment of the 
present invention. The image output system includes an 
image file generation device, an image processing sys- 
tem 100, and an image output device, which are mutu- 
ally connected via a network INT. In this embodiment, a 
digital still camera 10 is used as the image file genera- 
tion device. The image file generation device is, howev- 
er, not restricted to the digital still camera 1 0 but may be 
any camera device like a digital video camera or a scan- 
ner. Available examples of the image output device in- 
clude a printer PRT, a network display DSP, and a liquid 
crystal projector PR J. The image file generation device 
and the image output device are connected to the net- 
work INT directly or via a computer. In this embodiment, 
the network INT may be a wide area network like the 
Internet or a restricted network like online communica- 
tion or a LAN (Local Area Network). 

A1 . Structure of Image File 

[0026] The image processing system 1 00 is a server 
having the functions of receiving image files from the 
digital still camera 1 0 and transmitting processed image 
files to the image output device. A typical structure of 
the image file input into the image processing system 
1 00 is illustrated in Fig. 1 . The image file has a data 
structure, in which picture data with attribute information 
mapped thereto is stored. In this embodiment, the image 
files adopt a specific file structure in conformity with the 
Exif (Exchangeable Image File) format standard for dig- 
ital still cameras. The Exif was established by JEIDA 
(Japan Electronic Industry Development Association). 



Although the Exif standard applies the JPEG format to 
record the picture data, the image files are not restricted 
to this format. 

[0027] The attribute information includes pieces of in- 
5 formation regarding camera conditions, like the date 
and time of photographing, exposure, and the shutter 
speed, control data of image processing, and output 
specification information. In this embodiment, based on 
the Exif standard, the control data and the output spec- 
io If ication information among the attribute information are 
recorded in an area MakeriMote. The recording area and 
its format may be arbitrarily set according to the selected 
format. 

[0028] The control data controls the details of image 
is processing on picture data at the time of outputting an 
image. In this embodiment, the control data mainly in- 
cludes two types of data, that is, a color space param- 
eter and a color correction parameter. 
[0029] The color space parameter is used to transmit 
20 a color reproduction characteristic in the image file gen- 
eration device to the image output device and thereby 
actualize precise color reproduction of a subject. This 
parameter includes a gamma correction value corre- 
sponding to the characteristic of the image file genera- 
ls tion device and a specification parameter for the color 
space conversion method. The specification parameter 
for the color space conversion method specifies the 
method of color conversion applied for image process- 
ing according to the width of the color reproduction 
so range by the image file generation device. This embod- 
iment uses color spaces of sRGB and NTSC. These two 
color spaces have different color reproduction ranges. 
Application of the same color conversion method for im- 
age processing may undesirably narrow the color repro- 
35 duction range of one color space. The specification pa- 
rameter is accordingly used to specify the adequate 
color conversion method and ensure image processing 
without narrowing the color reproduction range in shoot- 
ing. A diversity of formats may be used for setting the 
40 specification parameter. In this embodiment, the speci- 
fication parameter determines which of the sRGB and 
NTSC color spaces is used for shooting. A conversion 
matrix used for conversion of the color space may alter- 
natively be set as the specification parameter. 
45 [0030] The color correction parameter is data used for 
transmitting the intention of the photographer to the im- 
age output device. This parameter, for example, in- 
cludes parameters regarding the contrast, the bright- 
ness, the color balance, the saturation, the sharpness, 
50 and the registered color. The registered color represents 
a color used as the reference for tone adjustment of pic- 
ture data. These parameters are only illustrative. The 
control data may include other parameters or include 
only part of the parameters described above. 
55 [0031] The output specification information functions 
to control the specification of output from the image out- 
put device. When the image output device is a printer, 
for example, the output specification information speci- 
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fies the size and type of printing paper used for printing, 
the number of copies, and the time required for printing. 
The output specification information may also include 
address for specifying the output resource and informa- 
tion regarding the date and time of the output. It is, how- 5 
ever, not necessary that the specification of the output 
resource is included in the output specification informa- 
tion. The output resource may individually be specified 
in the process of receiving picture data from the image 
file generation device. ic 

A2. Structure of Image Processing System 

[0032] The functional blocks of the image processing 
system 1 00 are also illustrated in Fig. 1 . The respective 15 
functional blocks are actualized by software configura- 
tion in the image processing system 1 00. An input mod- 
ule 101 receives input of image files from outside; for 
example, input from the digital still camera 10 via the 
network or input via a recording medium. 20 
[0033] The input image file is subjected to image 
processing by an image processing module 102. The 
image processing module 102 extracts the control data 
for image processing from the input image file and proc- 
esses the picture data based on the extracted control 25 
data. 

[0034] The output specification information included 
in the image file is transmitted to a type information 
fetching module 103. The type information fetching 
module 103 gains access to each image output device 30 
based on the address for specifying the output resource 
included in the output specification information and 
fetches type information of the image output device. The 
type information affects the conversion process dis- 
cussed below, and includes information regarding the 35 
type of the image output device and information affect- 
ing the image output characteristics of the image output 
device. 

[0035] A data conversion module 1 04 carries out data 
conversion according to the type of the image output de- *o 
vice. Namely the data conversion module 104 converts 
picture data into an adequate format that enables im- 
mediate output from the image output device. When the 
image output device is a printer, the conversion process 
includes, for example, color conversion from RGB into *5 
CMYK and a halftoning process. The data conversion 
module 1 04 refers to a type mapping table 1 04T to ac- 
tualize the type-based processing. For example, when 
the image output device is a printer, the type mapping 
table 1 04T stores information regarding the type of ink, so 
such as dye ink and pigment ink, the number of ink 
colors used for printing, the printing resolution, and the 
conversion table applied for color conversion mapped 
to each type processible by the image processing sys- 
tem 1 00. The image processing system 1 00 can readily ss 
process newly available printers by updating the con- 
tents of this type mapping table 104T. The series of 
processing in the data conversion module 104 may al- 



ternatively be carried out in the image output device. 
[0036] An output file generation module 1 05 arranges 
the processed data and constructs an output file, which 
is transmittable to the image output device. The data 
converted by the data conversion module 104 may be 
specified as the output file, or the converted data with 
part of the output specification information attached 
thereto may be specified as the output file. The structure 
of the output file for the printer PRT specified as the im- 
age output device is also illustrated in Fig. 1 . In this ex- 
ample, the output file includes print data and the output 
specification information. Here the print data represents 
data converted into a specific format that allows imme- 
diate printing by the printer PRT. The output specifica- 
tion information is attached to a header of the print data 
in the output file. The attached output specification in- 
formation may be, for example, the type of printing paper 
used for printing and the number of copies. 
[0037] A transmission module 1 06 transmits the out- 
put file to the image output device via the network INT. 
The image output device receives the transmitted output 
file and prints or otherwise outputs a resulting image. 
When the output file includes the output specification in- 
formation,, the specification of output, for example, 
changeover of printing paper, is controlled by the output 
specification information. 

B. Structure of Digital Still Camera 

[0038] Fig. 2 illustrates the structure of the digital still 
camera 10 used as the image file generation device. In 
the digital still camera 1 0, picture data is generated by 
means of an optical circuit 121 including a CCD for col- 
lecting information of light rays and an image acquisition 
circuit 1 22 for converting voltage signals of the CCD into 
picture data. 

[0039] The picture data obtained here is defined in a 
YCbCr color space, which is suitable for image com- 
pression based on a JPEG format. A different series of 
processing to obtain picture data in the YCbCr color 
space from the voltage signal of the CCD is adopted cor- 
responding to the type of the digital still camera 10. 
[0040] The digital still camera 10 generally obtains 
picture data defined in the RGB color space from the 
voltage signal of the CCD. An sRGB color space and an 
NTSC color space are selectively used according to the 
type of the camera. Both the sRGB color space and the 
NTSC color space define color in the RGB coordinate 
system, while the NTSC color space has a wider range 
of color reproduction than the sRGB color space. In the 
sRGB color space, color is generally defined in the 
range of 8 bits (0 to 255). A color space that extends 
this range to negative values or values of and over 256 
(hereinafter referred to as the 'extended sRGB space') 
may be used instead of the general sRGB color space. 
Information on the color space used for shooting is in- 
cluded as the color space parameter described previ- 
ously and attached to the picture data as information 
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representing the color reproduction characteristics of 
the digital still camera 10. In this embodiment, the ex- 
tended sRGB space and the sRGB space are in the 
identical coordinate system and are expressed by the 
same parameters. These two color spaces may alterna- 5 
tively be expressed in a discriminative manner from 
each other. 

[0041] The 3X3 matrix computation converts the im- 
age obtained in the RGB color space into data in the 
YCbCr color space. Namely this matrix is used to con- 10 
vert the RGB coordinate system into the YCbCr coordi- 
nate system. A common matrix is applicable for both the 
sRGB color space and the NTSC color space used for 
shooting. 

[0042] The user operates an operation unit 126 to set is 
the shooting mode, an image processing control param- 
eter, and the layout. Information required for the setting 
is displayed on an LCD 1 27. The picture data thus ob- 
tained may be transmitted wirelessly by an aerial 125 to 
the image processing system 100 via the network INT. 20 
The picture data may be recorded in a memory card MC 
inserted in a memory card slot 128. 
[0043] A control circuit 1 24 controls the operations of 
the digital still camera 1 0. The control circuit 1 24 is con- 
structed as a microcomputer including a CPU and mem- 25 
ories. The functional blocks actualized by the software 
configuration for such control in the control circuit 124 
are also illustrated in Fig. 2. 

[0044] A picture data input module 11 receives input 
of picture data via a shooting module 1 2 or an MC input 30 
module 13. In the case of the shooting module 12, pic- 
ture data is generated by shooting that utilizes the opti- 
cal circuit 121 . In the case of the MC input module 13, 
picture data is read from the memory card MC. 
[0045] A control data setting module 14 sets the con- 35 
trol data included in the image file, in addition to the pic- 
ture data. The control data is used to control the details 
of the image processing, which is carried out forthe pic- 
ture data in the process of outputting the image. The 
user sets the control data, for example, at the time of 40 
shooting. An operation input module 15 and a display 
control module 16 give a user interface for the setting. 
The display control module 16 utilizes the LCD 127 to 
give information to the user, whereas the operation input 
module 15 inputs the operation of the operation unit 126. 45 
[0046] The user may arbitrarily set each item of the 
control data or select a desirable setting among a plu- 
rality of settings of the control data provided in advance. 
The setting of the control data may be selected, based 
on the relationship to the image output device specified so 
as the output resource, for example, the type of ink, dye 
ink or pigment ink, used in the printer specified as the 
output resource and the number of ink colors. The se- 
lection may also be based on the type of the image out- 
put device, for example, a color printer, a display, or a ss 
projector. The multiple settings of the control data may 
be mapped to one picture data. 

[0047] An image file generation module 17 specifies 



the mapping of the data from the control data setting 
module 1 4 to the data from the picture data input module 
11 and generates an image file. The structure of the im- 
age file is discussed previously with reference to Fig. 1 . 
[0048] The image file thus generated is output to out- 
side via a transmission module 1 8 or an MC output mod- 
ule 19. The transmission module 18 controls wireless 
communication via the aerial 125. The transmission 
module 18 functions to implement transmission of the 
image file to the image processing system 1 00 via the 
network INT. The MC output module 19 controls writing 
into the memory card MC. The image file written in the 
memory card MD can be transmitted to the image 
processing system 1 00 or any other suitable external 
device. 

D. Image Processing 

[0049] Fig. 3 is a flowchart showing an image 
processing routine, which is executed by the image 
processing system 100. The image processing system 
1 00 first receives input of an image file and specification 
of an output resource at step S1 0. The image file may 
be transmitted from the digital still camera 10 via the 
network or read from the memory card MC. The output 
resource is specified by information like a URI (Uniform 
Resource Indicator) or an IP address representing the 
location of the image output device on the network INT. 
In this embodiment, such information is included in the 
output specification information in the image file. Alter- 
natively such information may be specified by an oper- 
ation of the digital still camera 10 in the course of receiv- 
ing the image file. The image processing system 100 
analyzes the image file and extracts the picture data and 
the control data from the input image file. 
[0050] The image processing system 1 00 fetches the 
type information based on the specification of the output 
resource at step S12. In the procedure of this embodi- 
ment, the image processing system 1 00 gains access 
to the specified output resource via the network INT to 
fetch the type information. The type information includes 
information regarding the type of the image output de- 
vice, for example, a printer, a display, or a scanner, and 
information regarding the name of the manufacturer of 
the image output device. When a printer is used as the 
image output device, the type information includes in- 
formation regarding the type of ink, that is, pigment ink 
or dye ink, used for printing, the number of ink colors 
used for printing, and the printing resolution. The type 
information is utilized in a color conversion process and 
a halftoning process discussed later. 
[0051] The image processing system 100 subse- 
quently carries out image processing based on the in- 
formation thus obtained. As mentioned previously, in 
this embodiment, the picture data is defined in the YCb- 
Cr color space. The image processing system 1 00 thus 
converts the picture data in the YCbCr color space into 
data in the RGB color space used for shooting at step 
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S14. An inversion matrix, which is inverse to a matrix 
used for conversion from the RGB space to the YCbCr 
space in the digital still camera 1 0, is applied for this 
conversion. This process converts the picture data into 
the data in the color space used for shooting, that is, 
one of the NTSC color space, the sRGB color space, 
and the extended sRGB color space. In the case of con- 
version into the extended sRGB color space, the color 
reproduction range includes negative values and values 
of and over 256. 

[0052] The image processing system then performs 
gamma correction of the picture data at step S1 6. The 
gamma value used for the gamma correction is included 
in the control data as information representing the char- 
acteristic of the digital still camera 10. 
[0053] After completion of the gamma correction , the 
image processing system 100 converts the color space 
of the picture data into the wRGB color space, which is 
defined to have the wider color reproduction range than 
the sRGB color space. When the picture data defined 
in either the NTSC color space or the extended sRGB 
color space is processed in the sRGB color space hav- 
ing the narrower color reproduction range, the colors of 
the subject may not be reproduced accurately. From this 
point of view, the picture data generated in the sRGB 
color space may skip a series of processing discussed 
below. In this embodiment, however, the color space in- 
formation included in the control data does not discrim- 
inate the sRGB color space from the extended sRGB 
color space. The procedure of this embodiment accord- 
ingly carries out conversion of the picture data generat- 
ed in the sRGB color space into data in the wRGB color 
space. Even under such conditions, since the picture 
data in the extended sRGB color space includes nega- 
tive values or values of or over 256, the extended sRGB 
color space may be distinguished from the sRGB color 
space based on these tone values. 
[0054] Matrix computation is applied for the conver- 
sion into the wRGB color space. As described previous- 
ly, the image processing system 1 00 deals with picture 
data defined in either the sRGB color space or the ex- 
tended sRGB color space and the picture data defined 
in the NTSC color space. Matrixes for directly converting 
the picture data in the respective color spaces into data 
in the wRGB color space may be specified. The proce- 
dure of this embodiment, however, carries out conver- 
sion via a standard XYZ color space. 
[0055] The image processing system 1 00 first carries 
out conversion from the RGB color space to an XYZ 
color space at step S18. The conversion process de- 
pends upon the color space in which the picture data is 
defined. The procedure of this embodiment accordingly 
provides two conversion matrixes in advance, that is, a 
conversion matrix TM1 for the sRGB color space or the 
extended sRGB color space and another conversion 
matrix TM2 for the NTSC color space, and selectively 
uses one of the two conversion matrixes TM1 and TM2 
to implement conversion according to the color space 



used for shooting. The conversion changes the individ- 
ual color spaces, in which the picture data is generated, 
into the standard XYZ color space. 
[0056] The image processing system 1 00 then carries 
s out conversion from the XYZ color space to the wRGB 
color space at step S20. Matrix computation is also ap- 
plied for this conversion. An identical matrix is used for 
this conversion, irrespective of the color space in shoot- 
ing. The matrix used for the computation may be set ar- 
10 bitrarily according to the definition of the wRGB color 
space. 

[0057] As described above, the picture data obtained 
in the sRGB color space is not required to be converted 
into data in any wider color space, so that the processing 

is ofstepsS18andS20maybeskipped. In the case where 
the NTSC color space is utilized as the wider color space 
than the sRGB color space, the picture data obtained in 
the NTSC color space may skip the processing of steps 
S1 8 and S20. The processing of steps St 8 and S20 can 

20 be omitted according to the relationship between the 
color space used for shooting and the color space finally 
used for the output. 

[0058] After completion of the color space conversion 
process, the image processing system 100 carries out 
inverse gamma correction at step S22. The gamma val- 
ue used here is set, based on the color reproduction 
characteristics of the image output device. In this em- 
bodiment, the image processing system 1 00 receives 
the gamma value from the image output device in the 
so process of fetching the type information at step S1 2. In 
the case where the type of the image output device is 
known at the time of shooting, the type information may 
be included in the control data attached to the picture 
data. 

35 [0059] The image processing system 100 subse- 
quently carries out automatic adjustment of the picture 
quality to reflect the intention of the photographer in 
shooting at step S24. In this embodiment, the adjust- 
ment parameter with regard to, for example, the contrast 
40 is included as the color correction parameter in the con- 
trol data. The image processing system 1 00 implements 
automatic adjustment of the picture quality, based on 
this parameter. The method of adjusting the picture 
quality based on such a parameter is known in the art 
*s and is thus not specifically described here. 

[0060] This series of processing completes the cor- 
rection of picture data that reflects the color reproduction 
characteristics of the digital still camera 10 and the in- 
tention of the photographer in shooting. The image 
w processing system 1 00 may output the resulting picture 
data to the image output device without any further 
processing. The procedure of the embodiment, howev- 
er, converts the processed picture data into a specific 
format that allows direct output from the image output 
5 device. 

[0061] The details of such conversion are discussed 
below in an example of the printer as.the image output 
device. The image processing system 100 causes the 
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RGB picture data to be subjected to a color conversion 
process corresponding to the type of the printer at step 
S26. This process converts the RGB color system into 
the CMYK color system used in the printer. The conver- 
sion is performed by referring to a conversion lookup 
table (LUT) that maps the colors of one color system to 
the colors of the other color system. The procedure of 
this embodiment typically uses a conversion table LUTw 
for conversion of the wRGB color space into the CMYK 
color space. The image processing system 100 also 
stores another conversion table LUTs f or the sRG B color 
space , in order to allow processing of picture data de- 
fined in the sRGB color space. The image processing 
system 1 00 selectively uses the adequate conversion 
table corresponding to the color space in which the pic- 
ture data is defined. The conversion table LUTs may be 
used, for example, when the color space conversion 
process of steps S1 8 and S20 is skipped for the picture 
data obtained in the sRGB color space and when the 
input image file is output without any processing for ad- 
justing the picture quality. 

[0062] The LUT depends upon not only the color 
space of picture data but the type of the printer, since 
the type of ink and the number of ink colors may be var- 
ied in each type of the printer. The image processing 
system 1 00 thus selectively uses the adequate LUT cor- 
responding to the type of the printer and carries out the 
color conversion process at step S26. 
[0063] The image processing system 1 00 then carries 
out halftoning of the picture data converted to the tone 
values of CMYK at step S28. The halftoning process en- 
ables the tone values of picture data to be expressed by 
the density of dots formed by the printer. Any known 
method like the error diffusion method or the systematic 
dither method may be applied for the halftoning process. 
[0064] In addition to the above series of processing, 
the image processing system 1 00 may carry out a res- 
olution conversion process, which converts the resolu- 
tion of picture data into a printing resolution adopted in 
the printer, and an interlace data generation process, 
which sets a data arrangement and feeding quantities 
of sub-scan to enable interlace recording in the printer. 
[0065] The picture data is converted into a specific for- 
mat of print data that enables immediate output from the 
printer through the conversion at steps S26 and S28. 
The image processing system 100 then transmits the 
resulting converted data as the output file to the speci- 
fied image output device via the network INT at step 
S30. The image output device implements printing 
based on the transmitted data. 

[0066] At least part of the output specification infor- 
mation, in addition to the print data : may be included in 
the output file according to the requirements. For exam- 
ple, the output specification information regarding the 
number of copies and the type of printing paper used for 
printing may be included in the output file to ensure out- 
put according to the specification. Arbitrary setting may 
be applied to make the output specification information 



included in the output file; for example, the output spec- 
ification information may be added to the header of the 
print data. 

5 D. Effects 

[0067] In the image output system of the embodiment 
discussed above, the control data includes the color re- 
production characteristics of the image file generation 
10 device and the intension of shooting to ensure output of 
an image reflecting such specification. The image 
processing system 1 00 on the network enables image 
processing based on the control data without depending 
upon the output environment, for example, the process- 
es ing capacity of the image output device. 

[0068] The image output system of the embodiment 
utilizes the image output device connecting with the net- 
work. The user can thus output images from an arbitrary 
image output device. This arrangement enables images 
20 to be outputto any third person who is at a remote place. 
The output does not depend upon the output environ- 
ment of the receiver who receives images, but reflects 
the color reproduction characteristics in shooting. 
[0069] In the image output system of the embodiment, 
25 data transmission from the image processing system 
100 to the image output device is implemented in the 
specific data format that allows immediate output from 
the image output device. This advantageously relieves 
the load of processing in the image output device. 

30 

E. Modifications 

[0070] The above embodiment regards output of im- 
ages to the printing apparatus. A display or a projector 
35 connecting with the network may be applied for output 
of images. 

[0071] The diverse series of image processing dis- 
cussed in the above embodiment may not be all execut- 
ed in the image processing system 1 00, but part of the 

40 image processing may be performed in the image file 
generation device or in the image output device. 
[0072] In this embodiment, the image processing sys- 
tem 1 00 is constructed by a single server. The image 
processing system may alternatively include multiple 

45 servers for distributed processing. 

[0073] Although the above embodiment regards ap- 
plication to still pictures, the principle of the present in- 
vention is also applicable to moving picture data like 
MPEG. One exemplified procedure adds output control 

so data including image processing control data to a mov- 
ing picture file and controls output of all or part of the 
frames of the moving picture. 

[0074] The above embodiment and its modifications 
are to be considered in all aspects as illustrative and not 
55 restrictive. There may be many modifications, changes, 
and alterations without departing from the scope or spirit 
of the main characteristics of the present invention. For 
example, the diverse control processes discussed 
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above may be attained by the hardware structure, in- 
stead of the software configuration. 
[0075] The scope and spirit of the present invention 
are indicated by the appended claims, rather than by the 
foregoing description. 



Claims 

1. An image processing system that carries out image 
processing on picture data, 



changes over details of the conversion correspond- 
ing to a type of said image output device. 

5. An image processing system in accordance with 
claim 2, wherein the picture data is associated with 
output specification information that specifies out- 
put style from said image output device, and 

said transmission module controls the output 
style from said image output device based on 
the output specification information. 



said image processing system being connect- 
ed with a printing device and a shooting device 
. via a network, 15 
said image processing system comprising: 

a receiver module that receives input of the 
picture data generated in said shooting de- 
vice and image processing control data as- 20 
sociated with the picture data via the net- 
work; 

an image processing module that causes 
the picture data to be subjected to image 
processing based on the image processing 25 
control data and conversion into a data for- 
mat that allows supply to said printing de- 
vice, and thereby generates print data; and 
a transmission module that transmits the 
print data to said printing device via the net- 30 
work and causes said printing device to 
print a processed image. 

2. An image processing system that carries out image 
processing on picture data, 35 

an image input module that receives input of 
the picture data and image processing control 
data associated with the picture data; 
an image processing module that causes the <o 
picture data to be subjected to image process- 
ing based on the image processing control da- 
ta, and thereby generates image output data; 
and 

a transmission module that transmits the image *s 
output data to an image output device connect- 
ing with said image processing system via a 
network and causes said output device to out- 
put a processed image. 

so 

3. An image processing system in accordance with 
claim 2, wherein said image processing module fur- 
ther carries out conversion of the picture data into 
a data format that allows supply to said image out- 
put device. 55 

4. An image processing system in accordance with 
claim 2, wherein said image processing module 



6. An image processing system in accordance with 
claim 2, wherein the picture data is defined in a 
YCbCr color space, and 

the image processing includes color space con- 
version of the YCbCr color space into an RGB 
color space. 

7. An image processing system in accordance with 
claim 6, wherein the color space conversion in- 
cludes conversion into a predetermined RGB space 
that has a wider range of color reproduction than an 
sRGB color space. 

8. An image output method that utilizes an image 
processing system connecting with an imgae output 
device via a network to output an image based on 
picture data, said image output method comprising: 

inputting the picture data and image processing 
control data associated with the picture data; 
causing the picture data to be subjected to im- 
age processing based on the image processing 
control data, and thereby generating image out- 
put data; and 

transmitting the image output data to said im- 
age output device and causing said image out- 
put device to output a processed image. 

9. A computer program that causes an image process- 
ing system to output an image to an image output 
device connecting with said image processing sys- 
tem via a network, said computer program attaining 
the functions of: 

inputting picture data and image processing 
control data used for image processing of the 
picture data; 

causing the picture data to be subjected to im- 
age processing based on the image processing 
control data, and thereby generating image out- 
put data; and 

transmitting the image output data to said im- 
age output device and causing said image out- 
put device to output a processed image. 
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